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A Comparison of Career-Related Assessment Tools/Models 




; S^ECTION 
CRITERIA 
MET/ 

Pros • cons 


Pro: Assesses 
many of the 
CRLSskiUs 

Con: Assesses 
lower level and 
basic skills 


c3.. 

es.-.:.-. 

’S' 

s- 


Prices: 

Paper-and-Pencil 
format - $4.00 per 
assessment 

Videotape format - 


$7,00 per assessment 

Audiotape format 
ListeningAVriting - 


$16.00 

Listening only - 
$13.50 

Writing only - $12,50 

"There is a 15% 
discount for K-12 
school orders for 
these assessments. 

Job Profile (identify 
skills and skill levels 
for a particular type 
of job) - $4,(XK) fee 

Instructional Guides 
for skill areas - 
prices for guides 
range from $15.(X) to 
$40 for the first set 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


listening and 
Writing assessment 
scoring guides 
available. 

The WorkKeys 


instructional support 
component provides 
instructors, trainers, 
curriculum 


developers, and 
others involved in 
skills development 
with assistance in 
understanding the 
WorkKeys skills so 
that they can help 
individuals improve 
their workplace 
skills, whether by 
integrating these 
skills into existing 
courses and programs 
or by developing 
additional curricula. 

ACT provides a two 
part Resource Guide 
that lists companies 
that have developed 
instructional training 
for WorkKeys. 

Work Keys includes 
sample assessments 
and explanations of 
levels to help 
students become 
familiar with the 
types of questions 
theyll find on the 
tests. 


Evid^ceof . 

Fairness 

APPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


Reviewed by an external 
team of consultants for 
fairness to racial, ethnic, and 
gender groups. 

Statistical analysis of the 


items to determine whether 
items fimction differently for 
different groups of 
individuals (DIF analyses). 
Items that show DIF are 
eliminated 


KVIO^CE OF 
RELIABILITY 


Internal Consistencv 
Applied mathematics, 
a = .86 

Applied technology, 
a = .80 

listening, a = .85 


Locating infonnation, 
a = .77 

Observation, a = .72 
Reading for 
Information, a = .80 
Teamwork, a = ,74 
Writing, a = .89 


EVIDENCE OF 
VALIDITY • 


Content Validity 
Each assessment was 
developed by “first 
defining a 
hierarchical skill 
scale and then 


creating test Items to 
1 be representative of 
both the skill area 
and each skill level 
within that skill 
area,” 

Construct Validity 


Interrelations among 
all Work Keys* 
assessments 
Relationship with 
other (non-Work 
Key) instruments 
Relationship between 
writing prompts and 
actual work settings 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Work Keys is not 
specifically related 
tot the Endorsement 
Areas. However, it 
can be combined 
with other ACT 
career interest 
assessments. 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Related to 
Academic Content 
Standards: 

* Mcahematics 

(Applied 

Mathematics) 


* Science 

* Technology 
(Applied 
Technology) 

* English 
(listening and 
Writing; Locating 
Information; 
Reading for 
Information) 


1 OREGON 

CAREER 
RELATED 
LEARNING 
STANDARDS 
ADDRESSED 


Related to CRLS: 

* Problem Solving 
(Applied 
Mathematics and 
Locating 
Information) 

* Teamwork 
(Teamwork) 

* Communication 
(listening and 


wnong ana 
Reading for 
Information) 

* Employment 

Foundations 

(Applied 

Mathematics and 

Applied 

Technology) 


INTENDED 

POPULATION 


Grades 9-12(13- 
*17, Adult) 

Students and 
workers can 
document and 
advance their 
employability 
skills. 

Used by 
educators to 
assess basic skills 
and tailor 


instructional 
programs to help 
students acquire 
the skills 


employers need. 

Used by 
employers to 
assess 

employability 
skills and 
develop workers 
for a wide range 
of skilled jobs. 


INTENDED PURPOSE/ 
CURRENT USES/ 

format 


Work Keys is a paper- 
and-pencU assessment that 
shows students their skill 
levels in eight foundational 
skills (the skills needed to 
learn other skills): 


AoDlied Mathematics 
-33 M/C questions 
-45 min. session 


ADDuea lecnnoioev 
-32 M/C questions 
-45 min. session 
Listenine and Writine 


-Audio-taped messages 
-6 written response items 
-40 min. session 
Locatine Infonnation 


-38 M/C questions 
-45 min. session 
Observation 


-Videotape of 3 scenarios 
-36 M/C items 
-one 25 min. session, 
-one 35 min. session 
Readinafor Infonnation 


-33 M/C items 
-45 min. session 
Teamwoik 


-Videotape of 12 teamwork 
scenarios 

-36 M/C questions 
-Two 40 min. sessions 

Test results are sent as 
individual score reports 
with levels, not raw scores. 
Definitions are included for 
each level. Resource 
materials are available to 
assist administrators in 
determining the proficiency 
level. 


ASSESSMENT 

Tool/model 


ACr-WUKKKKYS 

Work Keys tests skills in 
problem-solving, 
communication, and 
teamwork. It also identifies 


me SJQU levels neeoea to ao 
specific jobs. 

Work Keys is used to: 

* provide a structure for 
documenting and improving 
individuals’ workplace skills 

* identify skills levels 
employees need for 
successful job performance 

* identify individuals with 
necessary skills 


♦ develop or focus training 
programs 

* build a foundation for 
business/education 
partnerships 
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S^ECTION 

"CRITERIA 

MET/ 

Pros - cons 


Pro: Addresses 
all the 

Endorsement 

Areas. 

Con: ACE is a 
career 
assessment 
program for 
specific career 
cluster areas. It 
mainly assesses 
career technical 
standards 
versus career 
related learning 
standards. 


eg / . g 
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Costs include item 
development and 
recruitment and 
training of scorers. 
There are also costs 
associated with 
scoring/reporting. 


TRAINING/ 
SCOiilNG GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
BXEMPLARTASK 
AVAILABLE 


Scoring guides: 
Yes 

Exemplar tasks: 
Yes 


Evidence OF 
Fairness/^ 
APPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


All items are reviewed for 
ethnic and gender bias. 
Field test results are 
reviewed to confirm the 
review process. Statistical 
analyses are used to 
support the committee 
review process. 


EVID^CEOF 

RELIABILITY 


Extensive reliability 
evidence has been 
obtained. Internal 
consistency reliability 
ranges from a = .80 
through a = .90. 

Inter-rater reliability 
for written response 
items averages around 
.80 across program 
areas. 


EVIDENCE OF 
' VALIDITY 


Content validity 
Committees of 
content experts 
were convened to 
develop and review 
all tasks and ensure 
their fidelity to the 
Model Curriculum 
Standards on which 
they are based. 
Additional review 
includes members 
of the community 
and employers. 

AllCDE 
assessments are 
reviewed by a 
technical advisory 
committee. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Related to 
Endorsement Areas: 

* Business and 
Management 

* Health Services 

* Industrial and 
Engineering 
Systems 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


ALb assessments 
are not structured 
to report 
achievement in 
academic content 
areas. 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


home overly with 
CRLS but 
measured within 
the context of the 
career cluster area. 


IKTENDED 

POPULATION 


Lareer-techmcal 

Students 

Career-technical 

Teachers 

STW partnerships 

Tech-Prep 

Programs 

Academies 


INTENDED PURPOSE/ 
CURRENT USES/ 
Format 


ALb IS designed to provide 
formal recognition to 
students who **perform 
outstandingly^* in their 
career-technical program. 

It is also designed to 
evaluate local programs and 
provide feedback for 
curriculum revision. 

Current Uses: 

* State-endorsed Student 
Recognition 

* Program Evaluation 

* STW Evaluation 

* Perkins Evaluation 

Assessment components 
include multiple-choice and 
written-response items. 


Assessment 

Tool/Model 


Assessments in Lareer ^ 
Education (ACE) 
(WestEd/CDE) 

ACE is an end-of-program 
secondary-level assessment 
for severd California career- 
technical areas including: 

* Agricultural Core 

* Computer Science and 
Information Systems 

* Food Service and 
Hospitality 

* Technology Core 
♦Healthcare 

Additional assessments are 
under development for: 

* Animal Science 

* Drafting 
♦Mariceting 
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Pro: AllCRLS 
are addressed. 
AU 

Endorsement 
Areas are 
addressed when 
used in 
conjunction 
with C-TAP. 
CPA is 
adaptable and 
flexible, it can 
be modified to 
fit the needs of 
individual 
schools. 
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There are costs 
associated with 
teacher training for 
implementation. 
Formal scorer 
training is also 
needed to 
understand the 
scoring process and 
to increase inter- 
rater reliability. 

Local adaptability: 
Entries for the CPA 
portfolio can be 
redesigned based on 
local needs. If 
materials are 
tailored to local 
districts there is 
additional time and 
cost involved. 

There is local 
flexibility in terms 
of when and in 
which grades it is 
implemented. 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
BXEMPLARTASK 
AVAILABLE 


Scoring guides are 
included. 

Samples of student 
work are included. 

Training for 
implementation and 
scoring is available. 
For an additional 
cost, it is also 
possible to have on- 
going training 
throughout the 
school year. 


Evidence OF 

FiURNES^' 
AFPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


CPA has been 
implemented with diverse 
student populations. Data 
are available on group 
differences. 

Although CPA is a 
language based portfolio 
assessment, the materials 
and instructions are written 
in clear simple language. 


EVip^CE OF 
RELIABILITY 


Sconng mter-rater 
reliability has been the 
primary measure; this 
has been found to 
range from .69 to .75 
when accon^anied by 
substantial formal 
training. 

Training time and 
scorer diversity impact 
reliability. 


EVIDENCE OF 
: VALIDITV ' 


Content validitv 
Conunittees of 
content experts 
were convened to 
develop and review 
all tasl^ and ensure 
their fidelity to the 
Career Preparation 
Standards (CPS) on 
which they are 
based. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


When used m 
conjunction with 
theC-TAP.all 
Endorsement Areas 
can be assessed. 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


LEA IS not 
structured to report 
achievement in 
academic content 
areas. 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


^igmncani overlap 
with the CRLS. 


INTENDED 

POPULATION 

— 


uraaesy-iz 

CPA is used by 
educators at the 
school district 
level and 
employers. 
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^rA was aesignea as a 
formal certification system 
for career-majors and 
generic workplace 
readiness skills, 
respectively. 

CPA is currently being used 
for a variety of purposes 
including: 

* Curriculum Revision 

* Increased career 
awareness 

* Interdisciplinary 
collaboration 


ii ; 
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v^areer roraoiio 
Assessment (CPA) 
(WestEd) 

CPA, developed based 
on the C-TAP model, 
is a standards-based 
portfolio assessment 
of generic workplace 
readiness standards. 
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; S^ECTION 
CIUTERIA 
MET/ 

Pros - cons 


Pro: AUCRLS 
and 

Endorsement 
Areas are 
addressed. 
C-TAPis 
adaptable and 
flexible, it can 
be modifled to 
fit the needs of 
individual 
schools. 

Con: 

Implementation 
of all three 
components is 
sometimes 
considered time 
intensive. 


M- ' 

ri'.. 


There are costs 
associated with 
teacher training for 
implementation. 
Formal scorer 
training is also 
needed to 
understand the 
scoring process and 
to increase inter- 
rater reliability. 

Local adaptability: 
Entries for the 
C-TAP portfolios 
can be i^esigned 
based on local 
needs. If materials 
are tailored to local 
districts there is 
additional time and 
cost involved. 

There is local 
flexibility in terms 
of when and in 
which grades it is 
implemented. 


: TRAINING/ 

SCb^G GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


Sconng guides are 
included. 

Samples of student 
woric are included. 

Training for 
implementation and 
scoring is available. 
For an additional 
cost, it is also 
possible to have on- 
going training 
throughout the 
school year. 


Evidence OF . 

Fairness ^ 
APPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 

— ^ 


All C-TAP Items are 
reviewed for ethnic and 
gender bias. Field test 
results are reviewed to 
confirm the review 
process. 

Although C-TAP is a 
language based portfolio 
assessment, the materials 
and instructions are written 
in clear simple language. 


EVID^CE OF 
RELIABILITY 


5Conng mter-rater 
reliability has been the 
primary measure; this 
has been found to 
exceed .7 when 
accompanied by 
substantial formal 
training. 

Training time and 
scorer diversity impact 
reliability. 
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A lecnmcai 
Advisory 
Committee has 
overseen all 
development of 
C-TAP and helped 
design a series of 
construct validity 
studies. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 

1 — 771 ; ^ 


Au enaorsemem 
areas can be 
assessed via the 
C-TAP assessment 
system. 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


1 AT is noi 
structured to report 
achievement in 
academic content 
areas. 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


oignmcani overlap 
with the CRLS. 


INTENDED 

POPULATION 


oraoes y-iz 

C-TAP is used 
by educators at 
the school 
district and state 
level, colleges, 
and employers. 


INTENDED PURPOSE/ 
CURRENT USES/ 
Format 


was uesignea as a 
formal certification system 
for career-majors and 
generic workplace 
readiness skills, 
respectively. 

C-TAP is currently serving 
primarily as a teaching and 
learning tool and as a local 
assessment in vocational 
education programs. 

Current Uses for C-TAP 
include: 

* Program Evaluation 

* Support Whole-school 
Reform 

* Curriculum Revision 

* Student Certification 

* Increased career 
awareness 

* Interdisciplinary 
collaboration 


1 ASSESSMENT 
Tool/Model 


\..areer - 1 ecnmcai 
Assessment Program 
(C-TAP) 

(WestEd) 

C-TAP (a standards- 
based assessment 
system) is comprised 
of a Portfolio, Project, 
and Written Scenario. 
It is referenced to 
standards in various 
career areas, 
including: 

* Agriculture 

* Business 

* Health Careers 

* Home Economics 

* Industrial 

* Technological 
Education 



A Comparison of Career-Related Assessment Tools/Models 



o 

ERIC 




CO 



CO 



00 



A Comparison of Career-Related Assessment Tools/Models 



o 

ERIC 



SELECTION 

CRITERIA 

MET/ 

Pros • cons 


Con: Not 
explicitly 
focused on 
SCANS skills, 
more geared 
toward health, 
safety, hygiene, 
physical 
education, and 
some career 
preparation 
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There are high costs 
associated with item 
development, pilot 
tests, bias review, 
and scoring. 


TRAINING/ 
Scb^G GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


Scoring guides: 
Yes 

Exemplar tasks: 
Yes 


Evidence OF 
Fairness/' 
APPROPRUTENESS 

FOR SPECIAL 
POPULATIONS 


All items must be reviewed 
and approved by a bias 
review committee 
representing gender, 
etlmicity, and special 
education populations. 


EVIDENCE OF 
RELIABILITY 


Extensive evidence of 
reliability and 
generalizability has 
been obtained over the 
past eight years. 
Because of the 
emphasis on school* 
level accountability, 
attention has focused 
on the reliability of the 
schooLbased index. 
Individual content 
areas approach a = 

.90; the overall index 
exceeds a = .90. 

The reliability of the 
scoring of written 
response items 
approaches .8. 


EVIDENCE OF 

validitV 


Content Validitv 
All test items (M/C 
and W/R) are 
developed by the 
Content Advisory 
Committees 
comprised of 
current Kentucky 
teachers. All items 
arc reviewed by 
state content experts 
to ensure fidelity to 
the academic 
expectations and 
core content of 
assessment. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


CATS PL/VS is not 
related to the 
Endorsement Areas. 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


CATS PL/VS has 
extensive overlap 
with all academic 
content areas, 
including CIM and 
CAM 

expectations, as 
well as item 
formats and test 
structure. 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


Extensive overlap 
with: 

* Problem Solving 

* Employment 
Foundations 

* Career 
Development 

* Communication 
(written) 


INTENDED 

POPULATION 


All students are 
required to 
participate in 
CATS including 
special 
education 
students. lEP- 
exempt students 
are required to 
complete an 
alternate 
portfolio based 
on their 
education plan. 


INTENDED PURPOSE/ 
CURRENT USES/ 

Format 


CATS measures student 
achievement of the 
Academic Expectations and 
the Core Content of 
Assessment. Combined, 
these comprise the 
statewide content standards 
approved by the Kentucky 
Board of Education. 

CATS results are used as 
part of an overall state 
accountability formula to 
reward successful schools 
and improve deficient ones. 

Current Uses: 

* Feedback to students 

* Curriculum review and 
revision 

* School, District, and 
Statewide Accountability 
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Commonwealth 

Accountability 

Testing System 

Practical 

Living/Vocational 

Studies 

(CATS PL/VS) 
(Kentucky Dept of 
Education) 

CATS is the 
statewide 
assessment for the 
state of Kentucky. 
All students (grades 
4 - 12) are tested in 
a variety of content 
areas including: 
Reading, Writing, 
Mathematics, 
Science, Social 
Studies, Arts and 
Humanities, and 
Practical 
Living/Vocational 
Studies (PL/VS). 

The PL/VS 
sections, consisting 
of multiple-choice 
and written- 
response items, are 
assessed in grades 
5, 8, and 10. 
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Pro: Nationally 
recognized 
competitiorL 
sponsored and 
endorsed by 
many in 
industry 

Con: Can be 
costly and 
difficult to 
replicate the 
design and 
participation by 
industry 


si ' 

e '■ 

'e 


There are high costs 
related to putting 
together a national 
competition such as 
costs for equipment, 
materials, and 
facilities; labor for 
contest design, 
setup, judging, and 
breakdown; and 
personal 

transportation to the 
conference site. 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


r The specific content 
1 of tests is changed 
every year, though 
most of the subject 
material covered 
remains consistent 
from one year to the 
next Teachers can 
obtain tests from 
previous years for 
use in their 
classrooms. 


Evidence OF « 
Fairness/ 

APPROPRIATENESS 
FOR SPECIAL 
POPULATIONS 


It is not likely that a 
person's gender or 
race/ethnicity to influence 
expert judges of the job 
skills tests, because many 
judges fill out the scoring 
sheets for the products 
after contestants have 
departed. 


EVIDENCE OF 
RELIABILITY 


Judges are given 
objective criteria to 
use in making 
decisions about 
correctness of 
responses or 
performances. In 
cases where subjective 
judgment enters into 
the score, there is 
probably more 
variation among the 
judges* scores. 
However, these 
differences likely even 
out in the total scores. 

To encourage 
consistency in judging, 
new judges are put on 
a team with 
experienced judges; 
the new judge’s work 
is carefully monitored 
by the experienced 
judges. 


EVIDENCE OF 
VALIDITY 


Content Validitv 
Corporate leaders 
and practitioners 
from over sixty 
fields convene to 
develop the tests, 
which are designed 
to measure skills 
required in those 
fields to be relevant 
anywhere in the 
nation. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Related to 
Endorsement Areas: 

* Industrial and 
Engineering 
Systems 
(Electronic 
Products Servicing 
and Precision 
Machining 
Technology) 

* Arts and 
Communication 
(Advertising 
Design/ 

Commercial Art) 

* Health Services 
(Practical Nursing) 

* Business and 
Management 
(Job Skills 
Demonstration in 
Leadership 
Development 
contests) 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Related to 
Academic Content 
Standards: 

* Mathematics 

* Science 

* English 
*Arts 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


AllCRLSare 
addressed in the 
SkiUsUSA 
Championships 


INTENDED 

POPULATION 


Grades 9-12 
Adults 


INTENDED PURPOSE/ 
CURRENT USES/ 
Format 


The purpose of contests is 
to document students* skill 
mastery, encourage 
excellence, and increase the 
competence of entry-level 
workers. Indirectly, VICA 
aims to improve instruction 
and curriculum. 

In many contest areas, a 
written exam is included; 
items are usually multiple 
choice, but sometimes are 
constructed response. 

Winners are determined by 
the total scores on all 
components, or contest 
stations, from all judges. 

The contests are judged 
using criterion-referenced 
scoring. In most cases, 
contests combine objective 
questions that have a single 
right answer (e.g., multiple 
choice, yes/no, or 
mathematical question) 
with aesthetic or subjective 
judgments (e.g., in 
cosmetology, advertising 
design, culinary arts) about 
student progress. In some 
cases, points are awarded 
for overall quality of a 
product, introducing a 
holistic element to the 
scores. 


ASSESSMENT 

Tool/model 


SkiUsUSA 
Championships 
(Vocational/ 
Industrial Clubs of 
America (VICA)) 

The SkiUsUSA 
Championships 
cover a broad range 
of vocational fields, 
test generic and job- 
specific skills and 
use several forms of 
assessment 

Two types of 
contests are: 

* Job skills contests 
where individuals 
compete in 
performing job- 
related skills and 
applying relevant 
knowledge from 

. vocational field 
they are studying 

♦ Leadership 
development 
contests which 
assess 

demonstration of 
generic and 
employment- 
leanness skills. 


^ — . 





LO 

CO 



CO 



A Comparison of Career-Related Assessment Tools/Models 



o 

ERIC 




CO 






CD 

CO 



Q 

O 



2 



o 

o 

H 





< 





05 

CO 



«0 



'3D 

CO 



o 

ERIC 



z 






H S 






9.5 « « H “ 

S o 2 p tf « 

5 s b S 3 d 




'5 fe « S 
fa q p - 






§3 g cd OU fe 

« .2 6 J 3 « 3 6 
P y cx ^ O O 4 « n 

I - I 

^SS^S’>oSS« 



c «n 

s I 



« ^ 
o ,i 2 

!i| 

^ -S 

_ 2 g o 

50 B P fcS 
HI S 



U . 



, *3 






p 



»o 



U 



J» , 

c <^ <« 

o • a 

■S I 

mJ^ c^ o 

* 'n 

.ji ^ Q 

C m O cs 

CU fN 1 ^ 



1: 







> 
, ’’B 






pi 

s.g a 




o 

o P ^ 

tS’S 

(2 iS 



sg 

i.| 



e|s 





51 
■S' ® 
2 b 
B •= 

P *P 

o S 
e -2 
V 3 
o 73 

U o 



i 3 

e 



13 ^ 

il 
&s 
2 ^ 

li 



I 



T 3 

P 

:sl 






z a s 




•« 
ao 



B 2 I •§ « *3 5 ^ ;3 

•S i ^ M c S ^ d 

^t§a.E.ss^2St?43& 

e^* §^<H* s 2 .^SO* 550 




cs 

e e 



I 



V 5 < 



s< I ^ 

is'g o 

SC'S- 
? 3 

M U 




CO 




A Comparison of Career-Related Assessment Tools/Models 



o 

ERIC 



SEtECTION 

CRITERIA 

MET/ 

Pros- CONS 


Con: The 
Career Planning 
Survey is more 
of a career 
guidance 
program than 
an assessment. 


Feasibility 


Interest and aptitude 
inventories plus 
abilities test for 
reading and 
numerical skiUs: 
1-499 -$3.60 each 
5-1999 - $3.35 each 
2,000+ - $3.10 each 

Interest and aptitude 
inventories orily: 
1-499 -$3.05 each 
5-1999 - $2.80 each 
2,000+ - $2.60 each 


training/ 
SCORING guide/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


Guidebook includes 
checklists, 
experience 
inventories, 
coursework plarmer, 
job family charts, 
world-of-work map 
to assist students in 
career planning. 


Evidence OF 
Fairness/ 

APPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


The ACT Fairness report 
for this assessment 
contains information about 
group and gender 
representation. 

Items were judged not to 
be biased. Guidelines for 
eliminating unfair tests 
include (1) Fair Portrayal, 
(2) Fairness in Language, 
and (3) Cultural Diversity. 

Materials are written at a 
basic reading level. 


EVIDENCE OF 
RELIABILITY 


Tool is claimed to be 
reliable. The ACT 
Fairness report 
provides information 
on reliability. 

Literature indicates 
that the Career 
Planning Survey 
provides reliable 
information that 
reflects current career 
development theory 
and career guidance 
needs. 


EVIDENCE OF 
VALIDITY 


Tool is claimed to be 
valid. The ACT 
Fairness report 
provides 

information on item 
development and 
review, pre-testing 
of items, 

operational forms 
construction, and 
test form analysis. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Academic Ability 
Tests attempts to 
coimect the 
irrq>ortance of 
ac^emic skills to 
all occupations 

Inventory of Work- 
Relevant Abilities 
and UNIACT 
address six career 
clusters - Business 
Contact, Business 
Operations, 
Technical, Science, 
Arts, and Social 
Service 

Related to 
Endorsement Areas: 

* Business and 
Management 

* Arts and 
Communications 

* Natural Resource 
Systems 

* Industrial and 
Engineering 
Systems 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Includes Academic 
Ability Tests 
covering Reading 
and Numerical 
Skills 

Related to 
Academic Content 
Standards: 

*Math 
♦ English 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


Includes an 
inventory of 
Work-Relevant 
Abilities and a 
World-of-Woric 
Map, which 
locates career 
fields according to 
their involvement 
with data, ideas, 
people, and things. 

Related to CRLS; 

♦ Career 
Development 

* Organizations 
and Systems 
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S^ECTION 

CRITERIA 

MET/ 

Pros - cons 


Pro: Includes 
academic 
achievement 
tests in English, 
Math, Reading, 
and Science 
Reasoning. 

Con: The ACT- 
PLAN is 
mainly an 
interest 
inventory that 
helps students 
plan career 
goals. It is not 
an assessment 
of career- 
related skills. 


e.:.' 
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3 hours to 
completed the entire 
assessment 

Testing window is 
between September 
25*** and De^mber 
4*. 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


Materials available 
include: 

♦PLAN test 
booklets 

♦ Guide for Using 
Your PLAN Results 

♦ Planning Guide 
for Students and 
Parents 

♦ Descriptions of 
the Skills and 
Knowledge 
Associated with 
PLAN and ACT 
Assessment Scores 


Evidence OF 
Fairness 

APPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


The ACT Fairness report 
for this assessment 
contains information about 
group and gender 
representation. 

Items were judged not to 
be biased. Guidelines for 
eliminating unfair tests 
include (1 ) Fair Portrayal, 
(2) Fairness in Language, 
and (3) Cultural Diversity. 


EVIDENCE OF 
RELIABILITY 


Tool is claimed to be 
reliable, comparable to 
the ACT college bound 
assessment The ACT 
Fairness report 
provides information 
on reliability. 

PLAN is norraed for 
sophomores in high 
school. 


EVIDENCE OF 
VALIDITY " 


Tod is claimed to be 
valid, comparable to 
the ACT college 
bound assessment 
The ACT Fairness 
report provides 
information on item 
development and 
review, pre-testing 
of items, 

operational forms 
constraction, and 
test form analysis. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Not specifically 
relat^ to 

Endorsement Areas. 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Achievement Tests 
in English, 
Mathematics, 
Reading, and 
Science Reasoning 

Related to 
Academic Content 
Standards: 

♦ Mathematics 

♦ English 

♦ Science 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


Related to CRLS: 

♦ Problem Solving 
(science 
reasoning) 

♦ Communication 
(reading) 

♦ Career 
Development 
(Educafional/Occu 
pational Plans) 


INTENDED 

POP1D.ATION 


PLAN is 
typically 
administered in 
the fall of the 
sophomore year. 

PLAN is 
intended for 
students who 
are college- 
bound as well as 
those who are 
likely to enter 
the workforce 
direcdy after 
high school. 


INTENDED PURPOSE/ 
CURRENT USES/ 

Format 


The purpose of PLAN is to 
help tenth graders build a 
solid foundation for future 
academic and career 
success and provide 
information needed to 
address school districts* 
high-priority issues. 

PLAN includes 
Achievement Tests in: 

♦ English 

♦ Mathematics 

♦ Reading 

♦ Science Reasoning 

Non-Academic Sections: 

♦ Interest Inventory 

♦ High School Course 
Information 

♦ EducationaJ/Occupational 
Plans 

♦ Needs Assessment Profile 

The Educational Planning 
and Assessment System 
(EPAS) is an assessment 
system available through 
ACT that includes Explore 
(an 8*** grade test similar to 
PLAN), PLAN (10*“ grade), 
ACT Assessment (college 
bound), and Work Keys. 


assessment 
ii§$^ TooiTModel 


ACT-PLAN 
PLAN is essentially the 
10*“ grade version of the 
ACT college-bound 
assessment It is an 
educational track test that 
primarily focuses on 
academic skills. 

PLAN is a comprehensive 
guidance resource that 
helps students measure 
their current academic 
development explore 
caieer/training options, and 
make plans for the 
remaining years of high 
school and post-graduation 
years. 

PLAN is intended to 
stimulate thinking and 
planning for life after high 
school, assess academic 
preparation for post 
secondary education, 
support high school course 
selection for junior and 
senior years, relate 
personal characteristics to 
educational and career 
options, help focus test 
preparation to improve 
ACT scores, and provides 
an estimated ACT 
Assessment composite 
score. 
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Pro: Takes 60 
minutes or less 
to complete. 
Reporting is 
immediate. 

Con: This is 
mainly a general 
aptitude and 
interest 
inventory test 


sS ■ 

e- 


The entire 
assessment process 
takes 60 minutes or 
less to complete. 

Requires the use of at 
least one computer. 
Schools typic^y 
purchase the so^are 
for one or more 
computers in their 
school computer labs. 
The cost for one 
computer to be set up 
with CareerScope 
software is $3,000. 
This includes set up, 
initial training, and 
unlimited testing. 
There is also an 
optional maintenance 
and software update 
service for $500. 
Costs are on a sliding 
scale based on the 
number of computers 
used. 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


Scoring/reporting of 
the CareerScope 
assessment is 
immediate. Results 
are printed when the 
assessment is 
complete. Local sites 
are trained on how to 
use the system, 
interpret guidelines, 
and understand score 
reports. 

A detailed users 
manual is also . 
included in the 
software package. 

There are no costs 
associated with initial 
set up and training — 
usually day. Local 
VRI representatives 
are available at a 
negotiable cost for 
follow up training. 


evidence OF V 

Fairness/' 
AFPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


Appropriate for general high 
school population down to a 
4* grade reading level. 

VRI offers comparable 
assessment services, 
APTICOM and VITAS, for 
special populations. These 
are generally administered to 
individuals or small groups. 
APTICOM was designed to 
test aptitudes and interest of 
special populations such as 
people in rehabilitation 
programs, welfare to work 
programs, at-risk youth, etc. 

VITAS includes a series of 
simulated workplace tasks. 

It was designed as a tool for 
behavior observation and 
focuses on interests, 
temperaments, aptitudes, and 
basic workplace skills. 


EVIDENCE OF 
RELIABILITY 


External evaluations 
claim that the tool is 
valid and reliable. 
Report being sent. 

Normed to a variety of 
populations 

Reliability is claimed to 
be 80-90%. 


EVIDENCE OF 

validitV ^ 


External evaluations 
claim that the tool is 
valid and reliable. 
Report being sent. 

CaieerScope's career 
recommendations 
and score reports are 
based upon standards 
set by the U.S. 
Department of Labor. 

Validity is claimed to 
be .6 to .9 depending 
on the factor being 
tested. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Related to 
Endorsement Areas: 

* Natural Resource 
Systems 

* Human Resources 

* Business and 
Management 

* Industrial and 
Engineering Systems 

* Arts and 
Communications 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Includes aptitude 
and interest area 
tests that are 
somewhat related to 
Oregon’s core 
academic skills. 

Related to 
Academic Content 
Standards: 

* Mathematics 

* English 

* Science 

* Social Science 

* The Arts 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


Includes aptitude 
and interest area 
tests that are 
somewhat relevant 
to CRLS. 

Related to CRLS: 

♦ Problem Solving 

* Communication 

1 


INTENDED 

POPULATION 


Designed for use 
by middle school 
students, high 
school students, 
careei/guidance 
counselors, and 
colleges. 

External 

evaluations claim 
that the tool is 
valid and 
reliable. Report 
being sent. 


INTENDED PURPOSE/ 
CURRENT USES/ 

Format 


CareerScope is software that 
may be us^ on a PC or over 
a network (V^dows® or 
Macintosh®) to provide a 
battery of self-administered 
career interest and aptitude 
tests. 

The Interest Inventory 
measures and identifies a 
user's attraction to careers 
that correspond to the U.S. 
Department of Labor's 
Interest Areas. These areas 
are: 

* Artistic 

* Plants/Animals 

* Mechanical 

* Business Detail 

* Accommodating 

* Lead/Influence 

* Scientific 

* Protective 
^Industrial 
♦Selling 

* Humanitarian 

* Physical Performing 
(The results fi-om the Interest 
Inventory are compiled into a 
comprehensive Individual 
Profile Analysis (IPA). The 
IPA objectively identifies 
each evaluee's most 
significant interest area 
preferences.) 

Critical aptitudes measured 
by CareerScope: 

* General Learning Ability 

* Verbal Aptitude 

* Numeric^ Aptitude 

* Spatial Aptitude 

* Form Perception 

* Clerical Perception 


a ASSESSMENT 

o Tool/Model 


Career Scope ^ 

(Vocational Research 
Institute) 

Career Scope is a self- 
administeral 
computerized career 
assessment and reporting 
system that measures 
both aptitude and 
interest It includes the 
essential components of 
VRI’s product 
“Apticom” which was 
developed as a 
computerized career 
assessment system for 
spedal populations in 
1982. 

CareerScope includes 
two parts: an interest 
inventory and an aptitude 
test The q)titude test is 
timed to include speed 
screening while the 
Interest Inventory is not 
The entire assessment 
should take one hour to 
complete. 

The results of Career 
Scope are intended to 
assist individuals in 
choosing an appropriate 
and meaningful career or 
course of study. 
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S^ECTION 

CRITERIA 

MET/ 

Pros - cons 


Con: This is 
mainly a career 
interest 

assessment tool. 


■ 

e - 

s 1 


Job-0 materials 
include reusable 
booklets and answer 
folders. Additional 
answer folders can 
be purchased at a 
nominal price. 

Job-0 booklet: 

$4.20 

Spanish Job-O 
booklet:$4.50 
Job-0 answer 
folder: $0.57 

Job-0 Software: 
$99.95 
Site license 
(unlimited users): 
$399.95 

Job-0 can be used 
individually or in 
groups and can be 
completed in one 50 
minute class period. 

For an expanded 
lesson, additional 
career awareness 
curriculum 
materials can be 
added by teachers to 
complement the 
Job-0 program. 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


No training is 
necessary for 
administering the 
Job-O. The 
program manual 
contains simple 
instructions for 
teachers and 
students. 


Evidence OF 
Fairness/ ^ 
APPROPRUTENESS 

FOR SPECIAL 
POPULATIONS 


Job-O Enhanced is 
available in both English 
and Spanish in the printed 
edition. 

Job-O 20(X) is written at a 
7th grade reading level. 


EVIDENCE OF 
RELIABILITY 


Normed for middle 
school and high school 
students. 

Reliability: In periodic 
tests, retests with 
standard time duration 
between 

administration there is 
evidence that a 
correlation above 90% 
is obtained between 
the scores obtained in 
the test and the scores 
obtained in the retest. 


EVIDENCE OF 
VALIDITY 


Claimed to be valid. 
Specific data is 
available on 
construct validity 
(inter-test 
conelations made 
with KUDER OIS), 
content validity 
(variables were 
cross-correlated 
with job-coding 
found in the 
Occupational 
Outlook Handbook, 
the COE, and the 
updated DOE), and 
predictive validity 
(anecdotal reports 
made by former 
users of Job-O). 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Not specincally 
related to the 
Endorsement Areas. 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Not specincally 
related to the 
academic content 
standards. 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 

1 ^ 


Keiatec to 
* Career 
Development 


INTENDED 

POPULATION 


oraoes /-iz 

Job-O is 
intended for 
middle school 
and high school 
students but has 
up to an adult 
interest level. 


INTENDED PURPOSE/ 
CURRENT USES/ 

Format 


1 JOD-^ zuuu ana 
Enhanced are in paper and 
pencil format They are 
also available in a Windows 
software format 

The Job-O can be 
. completely self 
administered and self 
scored by students. It is 
intended for classroom use. 

The answer folder contains 
information on 120 of the 
most popular, fastest 
growing occupations, with 
a listing of approximately 
1,000 related jobs. This is 
intended to assist students 
in career decision making. 
The students will be able to: 

* Match their interests with 
different education and 
training levels 

* Examine a career 
preparation options in 
school and community 

* Identify a tentative career 
choice and update 
individual career plans 

* E)evelop an educational 
plan to meet tentative 
career choices 


ASSESSMENT 

TOOL/MODEL 

^ 


JUU-U 

(CFKR Career 
Materials) 

The Job-O is a 
career assessment 
program. The Job- 
02000 and Job-O 
Enhanced are 
interest inventory 
assessments that are 
self-administered 
and self-scored by 
students. They can 
also be used as a 
tool for instruction 
by teachers. 

Job-O 2000 is a 
comprehensive 
program 

of self awareness, 
job exploration, and 
career decision 
making. It is not a 
test, it is a self- 
assessment career 
planning activity. 

Job-O Enhanced 
provides the student 
with the opportunity 
to explore 
occupations within 
eight occupational 
families. The jobs 
are sorted by level 
of education and 
training. 
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Con: VRn is 
simply a career 
interest 
measurement. 


s:;f' " 

c3„. 

e.,: 

? 

S 


This tool was 
designed to assess 
large groups 
relatively 
inexpensively. 

Costs vary depending 
on the version - hand 
scored or scantron. 
Depending on the 
form, the costs are 
between $0.75 to 
$1.00 per person. 


TRAINING/ 
SCORING GUIDE/ 
CHECKLIST/ 
RATING FORMS/ 
EXEMPLAR TASK 
AVAILABLE 


Scoring guides and 
users manuals are 
included with the 
assessment materials. 
If necessary, training 
is available by local 
VRI representatives 
for a negotiable cost 


Evidence OF 
Fairness/" 
APPROPRUTENESS 
FOR SPECIAL 
POPULATIONS 


VRn is written at a fourth 
grade reading level and 
offers age and gender- 
based norms. 

The paper and pencil 
version is also available in 
Spanish. 

VRI offers a comparable 
assessment APTICOM, for 
special populations. 
APTICOM was designed to 
test aptitudes and interest of 
special populations such as 
people in rehabilitation 
programs, welfare to work 
programs, at-risk youth, etc. 
It is generally administered 
to in^viduals or small 
groups. 


EVIO^CE OF 
RELIABILITY 


External evaluations 
claim that the tool is 
reliable. Reliability 
coefficients range from 
.74 to .86 depending on 
the Interest Area. 

VRn was initially 
normed for use by adults 
but recently renormed 
with high school age 
students. 


Esi 

P 

Q- < 


External evaluations 
claim that the tool is 
valid. Validity 
coefficients range 
from .72 to .85 
depending on the 
Interest Area. 


RELATIONSHIP 

TO 

ENDORSEMENT 

AREA 

FRAMEWORKS 


Related to 
Endorsement Area 
Frameworks: 

* Natural Resource 
Systems 

* Human Resources 

* Business and 
Management 

* Industrial and 
Engineering 
Systems 

* Arts and 
Communications 


RELATIONSHIP 
TO OREGON 
ACADEMIC 
CONTENT 
STANDARDS 


Not related to 
academic content 
standards. 


OREGON 

CAREER 

RELATED 

LEARNING 

STANDARDS 

ADDRESSED 


Related to CRLS: 
♦ Career 
Development 


INTENDED 

POPULATION 


Designed for use 
by adults and 
high school 
students. 


INTENDED PURPOSE/ 
CURRENT USES/ 

Format 


Vocational Research 
Interest Inventory (VRII) is 
a vocational interest 
inventory that is available 
in paper and pencil or PC 
formats. The paper and 
pencil version is also 
available in Spanish. 

The U.S. Department of 
Labor’s Interest Areas 
which VRn corresponds 
with are: 

* Artistic 

* Scientific 

* Plants/Animals 

* Protective 

* Mechanical 

* Industrial 

* Business Detail 

* Selling 

* Accommodating 

* Humanitarian 

* Lead/Influence 

* Physical Performing 


ASSESSMENT 

Tool/Model 


Vocational 
Research Interest 
Inventory (VRII) 
(Vocational 
Research Institute) 

The Vocational 
Research Interest 
Inventory (VRII), a 
162-item interest 
assessment, 
measures a user’s 
interest in 12 scales 
which correspond to 
the U.S. 

Department of 
Labor’s Interest 
Areas. 

It is a paper and 
pencil and PC 
version of the Interest 
Survey developed for 
VRI’s product 
“Apticom” (an 
individualized 
computer-based 
assessment for 
special populations). 
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